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TN THE CLAIMS 
Please amend the claims as follows: 

Claim 1 (Currently Amended): An obstacle detection system comprising: 
a plurality of TV cameras for inputting multiple images; 

an image storage unit for storing a plurality of images inputted from said TV cameras; 

a feature extraction unit for extracting from the images, lines existing on a plane in a 
three-dimensional space , from tho images ; 

a parameter computation unit for determining a relation to hold between the projected 
positions of an arbitrary point on said plane, upon the individual of said stored images, from the 
lines extracted by said feature extraction unit; and 

a detection unit for detecting a region absent from said plane, by using the relation 
computed by said parameter computation unit[[.]]i_and 

ga iH parameter computation unit configured to pr edeter mine said relation in a still state, 
and to determine an undated relation upon an e l apsed time b ased on the relation in a still state 
and the movement in said plane during the ela ps ed t ime of a t least one line extracted by said 
feature extracting unit. 

Claim 2 (Original): An obstacle detection system according to Claim 1, 
wherein said TV cameras are unknown on their relative positions and orientations and 
on their focal lengths and principal points. 

Claim 3 (Original): An obstacle detection system according to Claim 1 or 2, 
wherein the relation to hold between the projected points of an arbitrary point on the 
plane in the three-dimensional space upon the individual images is expressed by a two- 
dimensional affine transformation thereby to determine the affine transformation parameters. 
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Claim 4 (Currently Amended): An obstacle detection system according to any of 
Claims Claim 1 or 2 te^, 

wherein said feature extraction unit extracts a plurality of lines, as existing on the plane 
in the three-dimensional space and parallel to each other in the three-dimensional space, from 
the images, and determines the vanishing points of said lines. 

Claim 5 (Currently Amended): An obstacle detection system according to any of 
Claims Claim 1 or 2 te-£, 

wherein said feature extraction unit extracts a plurality of lines, as existing on the plane 
in the three-dimensional and parallel to each other in the three-dimensional space, from the 
images, and determines the inclinations of said lines on the images and the vanishing points of 
said lines. 

Claim 6 (Withdrawn): An obstacle detection system comprising: 

a plurality of image pickup units having light receiving units having light receiving 
units disposed on a driver's own vehicle at a substantial spacing from each other for taking the 
regions, to which the light receiving units are directed, simultaneously as images; 

an image storage unit for storing the images taken by said image pickup units; 

a feature extraction unit for extracting such ones of the regions taken by said image 
pickup units as correspond to parallel members disposed generally in parallel with each other 
on a plane, as can be traveled by said own vehicle, from the first image taken by said first 
image pickup unit and the second image taken by said second image pickup unit, as stored in 
said image storage unit, to determine intersection points at which said extracted regions 
intersect in said first and second images; 
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a difference detection unit for determining the corresponding region in the second 
image, as corresponding to an arbitrary region in said first image, assuming that said arbitrary 
region is arising from said plane, from the epipolar constraint to hold between said extracted 
region and said first and second images, to compare the intensities of said arbitrary region and 
said corresponding region, thereby to extract the region having a substantially different 
intensity as an obstacle region to obtain an obstacle region image from the extracted result; and 

a height computation unit for extracting a polygonal regions, as composed of an 
intensity higher than a standard value, of said obstacle region image thereby to detect as a true 
obstacle region said polygonal region of a threshold or higher value of the ratio which is 
determined from the vertical size of said polygonal region in said obstacle region image and the 
size from the lower end of said polygonal region to scan-line in said obstacle region image 
including said intersection point. 

Claim 7 (Withdrawn): An obstacle diction system comprising; 

a plurality of image pickup units having light receiving units disposed at a substantial 
spacing from each other for taking the regions, to which the light receiving units are directed, 
simultaneously as images; 

an image storage unit for storing the images taken by said image pickup units; 

a difference detection unit for determining the corresponding region in the second 
image, as corresponding to an arbitrary region in said first image, assuming that said arbitrary 
region is arising from a plane in a three-dimensional space, to compare the intensities of said 
arbitrary region and said corresponding region, thereby to extract the region having a 
substantially different intensity as an obstacle region to obtain an obstacle region image from 
the extracted result; and 
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a height computation unit for extracting a polygonal region, as composed of an intensity 

higher than a standard value, of said obstacle region image thereby to detect as a true obstacle 

region said polygonal region of a threshold or higher value of the reatio which is determined 

from the vertical size of said polygonal region in said obstacle region image and the size from 

the lower end of said polygonal region to the scan-line set in said obstacle region image. 

Claim 8 (Withdrawn): An obstacle detection system comprising: 
a first image pickup unit and a second image pickup unit for obtaining a first image 
information of a first image and a second image information of a second image, respectively, 
by taking the surrounding region of a driver's own vehicle substantially simultaneously as 
images formed of a set of pixels from light receiving units arranged at a spacing on the own 
vehicle; 

an image information storage unit for storing said first image information and said 
second image information; 

an intensity difference image forming unit for forming an intensity difference image by 
determining the corresponding pixels in said second image of the second image information, as 
assuming that an arbitrary pixel of said first image of said first image information stored in said 
image information storage unit exists on the ground plane being traveled by said own vehicle, 
to determine the intensity difference between said arbitrary pixel and said corresponding pixel; 

a discrimination image forming unit for obtaining a discrimination image by 
discriminating each pixel in said intensity difference image into a pixel having an intensity 
difference no less than a standard value and a pixel having an intensity difference less than the 
standard value; and 

a decision unit for detecting and deciding a region having a generally wedge-shaped set 
of pixels in said discrimination image as an obstacle region. 
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Claim 9 (Withdrawn): An obstacle detection system according to Claim 8, 
wherein said detection unit decides that the lowermost pixel in said wedge-shaped 
region of said discrimination image is either at a point of contact between said obstacle region 
in said first or second image, as corresponding to said discrimination image, and the ground 
being traveled by said own vehicle, or at a portion of said obstacle region and the closest to said 
own vehicle. 

Claim 10 (Withdrawn): An obstacle detection system according to Claim 8 or 9, 
wherein said detection unit decides that such one of said generally wedge-shaped region 
existing generally in the can-line direction of said first and second images, as corresponding to 
said discrimination image, that its side is at a higher location of said first and second images 
than the apexes opposed thereto, is the obstacle region. 

Claim 1 1 (Withdrawn): An obstacle detection system according to Claim 8, 
wherein said detection unit decides one pair of wedge-shaped regions generally of the 
same shape, as located at spacing on the generally identical scan-line in said discrimination 
image, and decides the region between said paired wedge-shaped regions as the obstacle. 

Claim 12 (Withdrawn): An obstacle detection system comprising: 

an image input unit for inputting and storing at least two images of different pickup 

points; 

a feature extraction unit for extracting a projected point of motion of an object, as 
stands still or moves on a plane in a three-dimensional space with respect to the pickup point of 
a standard image, upon said standard image corresponding to an infinite point, by employing 
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one of the images stored by said image input unit as said standard image and other as a 

reference image; 

a detection unit for calculating a corresponding point on said reference image when it is 
assumed that an arbitrary point of said standard image is on said plane, to detect a point non- 
existing on said plane from the intensity difference between said arbitrary point and said 

corresponding point; and 

a contact toe computing unit for computing the time period for the point non-existing 
on said plane to come ,0 the taken point of said standard image, one the basis of the point non- 
existing on said plane in said standard image, on the basis of the point non-existing on said 
p,a»e in said standard image detected by said detection unit and said projected point extracted 
from said feature extraction unit. 

Claim 13 (Withdrawn): An obstacle detection system according to Claim 12, 
wherein said contact time computation unite computes the time period for the point on 
the boundary with said plane to come to the taken point of said standard image, on the basis of 
such ones of the points detected by said detection unit but not existing on said plane, as are 
located on the boundary line with said plane in said standard image and are extracted as said 
projected point by said feature extraction unit. 

Claim 14 (Withdrawn): An obstacle detection system according to Claim 12 or 13, 
wherein said feature extraction unit extracts a plurality of lines aligned to the direction 
of the motion of an object which stands still or moves on said plane relative to the pickup point 
of said standard image to employ the point of intersection of the extracted lines, as said 
projected point. 
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Claim 15 (Withdrawn): An obstacle detection system according to any Claims 12 to 14, 
wherein said images are unknown on the relative positions and orientations of their 
pickup points and on their focal lengths and principal points. 

Claim 16 (Withdrawn): An obstacle diction system according to any of Claims 12 to 15, 
wherein said detection unit computes the corresponding point on said reference image 
when the arbitrary point on said standard image is assumed to be one said plane, to detect said 
non-existing point from a similarity of the surrounding intensities of said arbitrary point and 
said corresponding point. 

Claim 17 (Currently Amended): An obstacle detection method comprising: 
an image storage step of storing a plurality of images inputted from a plurality of TV 
cameras; 

a feature extraction step of extracting from the images, a line existing in a plane of 
three-dimensional spac e, from the imag e s ; 

a parameter computation step of determining a relation to hold between the projected 
positions of an arbitrary point in said plane upon the individual of said stored images, from the 
line extracted at said feature extraction step; aftd 

a detection step of detecting a region absent from said plane, by using the relation 
computed at said parameter computation step[[.]]; and 

said parameter computation step predetermines said relation in a still state, and 
determines an updated relation upon an elapsed time based on the relation in a still s tate and the 
movement in said plane during the elapsed time of at least one line extracted by said feature 
extracting unit. 
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.«iA p^meter computa tion sten predetermines said relation in a still state, and 
Haines an uo d^H ration unon ™ ela psed time based on the relation in a still state and the 
mrw .ment of at w one line ex ited in said feature extracting ste p, existing in said plane 
during the ela psed time. 

Claim 18 (Original): An obstacle detection method according to Claim 17, 
wherein said TV cameras are unknown on their relative locations and positions and on 
their focal lengths and principal points. 

Claim 19 (Original): An obstacle detection method according to Claim 17 or 18, 
wherein said parameter computation step expresses the relation to hold between the 
projected points of an arbitrary point of the plane in the three-dimensional space upon the 
individual images by a two-dimensional affine transformation thereby to determine the affine 
transformation parameters. 

Claim 20 (Currently Amended): An obstacle detection method according to aey-ef 

€4aims Claim 17_orJj5 te-49, 

wherein said feature extraction step extracts a plurality of lines, as existing on the plane 
in the three-dimensional space and parallel to each other in the three dimensional space, from 
the images, and determines the vanishing points of said lines. 

Claim 21 (Currently Amended): An obstacle detection method according to any-e# 
Claims Claim 17 or 18 te-49, 
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wherein said feature extraction step extracts a plurality of lines, as existing on the plane 

in the three-dimensional space and parallel to each other in the three dimensional space, from 

the images and the vanishing points of said lines. 

Claim 22 (Withdrawn): An obstacle detection method comprising: 

a plurality of image pickup steps of taking the regions, to which light receiving units 
disposed on a driver's own vehicle at a substantial spacing from each other are directed, 
simultaneously as images; 

an image storage step of storing the images taken by said image pickup steps; 

a feature extraction step of extracting such ones of the regions taken by said image 
pickup steps as correspond to parallel members disposed generally in parallel with each other 
on a plane, as can be traveled by said own vehicle, from the first image taken by said first 
image pickup step and the second image taken by said second image pickup step, as stored in 
said image storage step, to determine a point of intersection at which said extracted regions 
intersect in said first and second images; 

a difference detection step of determining the corresponding region in the second 
image, as corresponding to an arbitrary region in said first image, assuming that said arbitrary 
region is caused by said plane, from the epipolar constraint to hold between said extracted 
region and said first and second images, to compare the intensities of said arbitrary region and 
said corresponding region, thereby to extract the region having a substantially different 
intensity as an obstacle region to obtain an obstacle region image from the extracted result; and 

a height computation step of extracting a polygonal region, as composed of an intensity 
higher than a standard value, of said obstacle region image thereby to detect as a true obstacle 
region said polygonal region of a threshold or higher value of the ratio which is determined 
from the vertical size of said polygonal region in said obstacle region image and the size from 
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the lower end of said polygonal region to the scan-line in said obstacle region image including 
said intersection point. 

Claim 23 (Withdrawn): An obstacle detection method comprising: 

a plurality of image pickup steps of taking the regions, to which the light receiving units 
disposed at a substantial spacing from each other are directed, simultaneously as images; 

an image storage step of storing the images taken by said image pickup steps; 

a difference detection step of determining the corresponding region in the second 
image, as corresponding to an arbitrary region in said first image, assuming that said arbitrary 
region is caused by a plane in a three-dimensional space, to compare the intensities of said 
arbitrary region and said corresponding region, thereby to extract the region having a 
substantially different intensity as an obstacle region to obtain an obstacle region image from 

the extracted result; and 

a height computation step of extracting a polygonal region, as composed of an intensity 
higher than a standard value, of said obstacle region image thereby to detect as a true obstacle 
region said polygonal region of a threshold or higher value of the ration which is determined 
from the vertical size of said polygonal region in said obstacle region image and the size from 
the lower end of said polygonal region to the scan-line set in said obstacle region image. 

Claim 24 (Withdrawn): An obstacle detection method comprising: 
a first image pickup step and a second image pickup step of obtaining a first image 
information of a first image and a second image information of a second image, respectively, 
by taking the surrounding region of a driver's own vehicle substantially simultaneously as 
images formed of a set of pixels from light receiving units arranged at a spacing on the own 
vehicle; 
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an image information storage step of storing said first image information and said 
second image information; 

an intensity difference image forming step of forming an intensity difference image by 
determining the corresponding pixels in said second image of the second image information, as 
assuming that an arbitrary pixel of said first image of said first image information stored in said 
information storage step exists on the ground plane being traveled by said own vehicle, to 
determine the intensity difference between said arbitrary pixel and said corresponding pixel; 

a discrimination image forming step of obtaining a discrimination image by 
discriminating each pixel in said intensity difference image into a pixel having an intensity 
difference no less than a standard value and a pixel having an intensity difference less than the 
standard value; and 

a decision step of detecting and deciding a region having a generally wedge-shaped set 
of pixels in said discrimination image as an obstacle region. 

Claim 25 (Withdrawn): An obstacle detection method according to Claim 24, 
wherein said detection step decides that the lowermost pixel in said wedge-shaped 
region of said discrimination image is either at a point of contact between said obstacle region 
in said first or second image, as corresponding to said discrimination image, and the ground 
being traveled by said own vehicle, or at a portion of said obstacle region and the closest to said 
own vehicle. 

Claim 26 (Withdrawn): An obstacle detection method according to Claim 24 or 25, 
wherein said detection step decides that such one of said generally wedge-shaped region 
existing generally in the scan-line direction of said first and second images, as corresponding to 
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said discrimination image, that its side is at a higher location of said first and second images 
than the apexes opposed thereto, is the obstacle region. 

Claim 27 (Withdrawn): An obstacle detection method according to Claim 24, 
wherein said detection step decides one pair of wedge-shaped regions generally of the 
same shape, as located at spacing on the generally identical scan-line in said discrimination 
image, and decides the region between said paired wedge-shaped regions as the obstacle. 

Claim 28 (Withdrawn): An obstacle detection method comprising: 

an image input step of inputting and storing at least two images of different pickup 

points; 

a feature extraction step of extracting a projected point of motion of an object, as stands 
still or moves on a plane in a three-dimensional space with respect to the pickup point of a 
standard image, upon said standard image corresponding to an infinite point, by employing one 
of the images stored by said image input step as said standard image and the other as a 

reference image; 

a detection step of calculating a corresponding point on said reference image when it is 
assumed that an arbitrary point on said standard image is on said plane, to detect a point non- 
existing on said plane from intensity difference between said arbitrary point and said 

corresponding point; and 

a contact time computation step of computing the time period for the point non-existing 
on said plane to come to the taken point of said standard image, one the basis of the point non- 
existing on said plane in the said standard image detected by said detection step and said 
projected point extracted from said feature extraction step. 
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Claim 29 (Withdrawn): An obstacle detection method according to Claim 28, 

wherein said contact time computation step computes the time period for the point on 

the boundary with said plane to come to the taken point of said standard image, on the basis of 

such ones of the points detected by said detection step but not existing on said plane, as are 

located on the boundary line with said plane in said standard image and are extracted as said 

projected point by said feature extraction step. 

Claim 30 (Withdrawn): An obstacle detection method according to Claim 28 or 29, 
wherein said feature extraction step extracts a plurality of lines aligned to the direction 
of the motion of an object which stands still or moves on said plane relative to the pickup point 
of said standard image, to employ the point of intersection of the extracted lines, as said 
projected point. 

Claim 3 1 (Withdrawn): An obstacle detection method according to any Claims 28 to 30, 
wherein said images are unknown on the relative locations and positions of their pickup 
points and on their focal lengths and principal points. 

Claim 32 (Withdrawn): An obstacle detection method according to any of Claims 28 to 

31, 

wherein said detection step computes the corresponding point on said reference image 
when the arbitrary point on said standard image is assumed to be on said plane, to detect said 
non-existing point from the similarity of the surrounding intensities of said arbitrary point and 
said corresponding point. 

Claim 33 (New): An obstacle detection system according to Claim 3, 
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wherein said feature extraction unit extracts a plurality of lines, as existing on the plane 

in the three-dimensional space and parallel to each other in the three-dimensional space, from 

the images, and determines the vanishing points of said lines. 

Claim 34 (New): An obstacle detection system according to Claim 3, 
wherein said feature extraction unit extracts a plurality of lines, as existing on the plane 
in the three-dimensional and parallel to each other in the three-dimensional space, from the 
images, and determines the inclinations of said lines on the images and the vanishing points of 
said lines. 

Claim 35 (New): An obstacle detection method according to Claim 19, 

wherein said feature extraction step extracts a plurality of lines, as existing on the plane 

in the three-dimensional space and parallel to each other in the three dimensional space, from 

the images, and determines the vanishing points of said lines. 

Claim 36 (New): An obstacle detection method according to Claim 19, 

wherein said feature extraction step extracts a plurality of lines, as existing on the plane 

in the three-dimensional space and parallel to each other in the three dimensional space, from 

the images and the vanishing points of said lines. 
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